Papers with USim similarity score
Reference-less Measure of Faithfulness for Grammatical Error Correction (N18-2)
Copied to clipboard
| Challenge: | Existing reference-less measures (RLMs) for measuring grammaticality are expensive to collect and limited by the large number of valid outputs. |
| Approach: | They propose a semantic measure for Grammatical Error Correction that compares the semantic symbolic structure of the source and correction without relying on manually-curated references. |
| Outcome: | The proposed measure shows that it can be applied consistently to ungrammatical text, and that valid corrections obtain a high USim similarity score to the source, and invalid corrections get lower scores. |